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Issues in the Design of .Adaptive Middleware Load Balancing 
Ossama Othman, Douglas C. Schmidt 

August 2001 ACM SIGPLAN Notices , Proceedings of the ACM SIGPLAN workshop on 
Languages, compilers and tools for embedded systems LCTES '01 , 
Proceedings of the 2001 ACM SIGPLAN workshop on Optimization of 
middleware and distributed systems OM '01, volume 36 issue 8 
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terms 



Full text available: 'g] pdf( 239.32 KB) 



Load balancing middleware is used extensively to improve scalability and overall system 
throughput in distributed systems. Many load balancing middleware services are 
simplistic, however, since they are geared only for specie use-cases and environments. 
These limitations make it hard to use the same load balancing service for anything other 
than the distributed application it was designed for originally. This lack of generality forces 
continuous re-development of application-specie load balancin ... 
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In this paper, a new adaptive scheme is presented for dynamic load balancing on a 
message-passing multicomputer. The scheme is based on using easy-to-implement 
heuristics and variable threshold in migrating processes among the multicomputer nodes. 
It uses a distributed control over all processor nodes as coordinated by a host processor. 
Four heuristic methods for process migration are presented, which are distinguished by 
choosing different policies for process migration and threshold update. A ... 
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multiprocessors 

Kinshuk Govil, Dan Teodosiu, Yongqiang Huang, Mendel Rosenblum 
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ACM Transactions on Computer Systems (TOCS), volume 18 issue 3 
Publisher: ACM Press 

Full text available* "PI pdf(287 05 KB) Add ' tiona ' information: full citation, abstract, references, citings, index 

" terms, .review 

Despite the fact that large-scale shared-memory multiprocessors have been commercially 
available for several years, system software that fully utilizes all their features is still not 
available, mostly due to the complexity and cost of making the required changes to the 
operating system. A recently proposed approach, called Disco, substantially reduces this 
development cost by using a virtual machine monitor that laverages the existing 
operating system technology. In this paper we present a ... 

Keywords: fault containment, resource managment, scalable multiprocessors, virtual 
machines 
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Despite the fact that large-scale shared-memory multiprocessors have been commercially 
available for several years, system software that fully utilizes all their features is still not 
available, mostly due to the complexity and cost of making the required changes to the 
operating system. A recently proposed approach, called Disco, substantially reduces this 
development cost by using a virtual machine monitor that leverages the existing 
operating system technology. In this paper we present a syste ... 

5 Manageability, availability, and performance in porcupine: a highly scalable, cluster- Q 
^ based mail service 

^ Yasushi Saito, Brian N. Bershad, Henry M. Levy 

August 2000 ACM Transactions on Computer Systems (TOCS), volume 18 issue 3 
Publisher: ACM Press 

Full text available" f 51 ) pdf(2 52 MB) Additional Information: full citation, abstract, references, citings, index 
' " terms 

This paper describes the motivation, design and performance of Porcupine, a scalable mail 
server. The goal of Porcupine is to provide a highly available and scalable electronic mail 
service using a large cluster of commodity PCs. We designed Porcupine to be easy to 
manage by emphasizing dynamic load balancing, automatic configuration, and graceful 
degradation in the presence of failures. Key to the system's manageability, availability, 
and performance is that sessions, data, and underlying ... 

Keywords: cluster, distributed systems, email, group membership protocol, load 
balancing, replication 



6 A.dynamic [pad balancer for a parallel branch and .bound. algorithm 
R. P. Ma, F-S. Tsung, M-H. Ma 

January 1989 Proceedings of the third conference on Hypercube concurrent 
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Full text available: 1 ^ pdf(756,72 KB) Additional Information: full citation, abstract, references, citings, index 

terms 

This paper presents a load-balancing scheme for a parallel branch and bound (PBB) 
algorithm utilizing a dynamic load balancer (DLB). The PBB algorithm is used to solve a 
resource scheduling problem on the Hypercube. The DLB is included in the PBB algorithm 
and is distributed to each node to balance the workload during run time. The DLB is 
evaluated by implementing two PBB algorithms, with DLB and without DLB. Results show 
that the PBB with DLB is 3.14 times faster than the algorithm without ... 
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Umit Rencuzogullari, Sandhya Dwardadas 
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symposium on Principles and practices of parallel programming PPoPP 

'01, Volume 36 Issue 7 
Publisher: ACM Press 

Full text available* t p| pdf(344 17 KB) Addjtional Information: full citation, abstract, references, citings, index 
' ^ ' " terms 

Networks of workstations (NOWs), which are generally composed of autonomous compute 
elements networked together, are an attractive parallel computing platform since they 
offer high performance at low cost. The autonomous nature of the environment, however, 
often results in inefficient utilization due to load imbalances caused by three primary 
factors: 1) unequal load (compute or communication) assignment to equally-powerful 
compute nodes, 2) unequal resources at compute nodes, and 3) multip ... 

8 Load balancing in a distributed processing system for high-energy physics(UFMulti) Q 
Jagadeesh Kasaraneni, Theodore Johnson, Paul Avery 

February 1995 Proceedings of the 1995 ACM symposium on Applied computing SAC 
95 

Publisher: ACM Press 

Full text available:^ pdf(623,69 KB) Additional Information: full citation, references, index terms 



9 Distributed operating s yste ms 

Andrew S. Tanenbaum, Robbert Van Renesse 

December 1985 ACM Computing Surveys (CSUR), Volume 17 Issue 4 
Publisher: ACM Press 

Full text available: f£l p_df(_5.49 MB) Additional Information: full c itation , abstract , references, citings, index 
• [aj : terms, review 

Distributed operating systems have many aspects in common with centralized ones, but 
they also differ in certain ways. This paper is intended as an introduction to distributed 
operating systems, and especially to current university research about them. After a 
discussion of what constitutes a distributed operating system and how it is distinguished 
from a computer network, various key design issues are discussed. Then several 
examples of current research projects are examined in some detail ... 




10 Protecting web. servers from distributed denial of service attacks 
Frank Kargl, Joern Maier, Michael Weber 

April 2001 Proceedings of the 10th international conference on World Wide Web 
WWW '01 

Publisher: ACM Press 

Full text available:^ pdf(390. 23 KB) Additional Information: full citation, references, citings, index terms 
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11 Dynamic load balancing for adaptive meshes using s ymmetric broa dcast networks Q 
Sajal K. Das, Daniel J. Harvey, Rupak Biswas 

July 1998 Proceedings of the 12th international conference on Supercomputing ICS 
'98 

Publisher: ACM Press 

Full text available: Q pdf(1 .01 MB) Additional Information: full citation, references, index terms 




12 The effectiveness of multiple hardware* contexts 
Radhika Thekkath, Susan J. Eggers 

November 1994 ACM SIGPLAN Notices , ACM SIGOPS Operating Systems Review , 
Proceedings of the sixth international conference on Architectural 
support for programming languages and operating systems ASPLOS- 

VI, Volume 29 , 28 Issue 11,5 
Publisher: ACM Press 

Full text available" pdf(1 26 MB) Additional Information: f ull cita tion, ajbstract, references, citings, index 
. [a| - terms 

Multithreaded processors are used to tolerate long memory latencies. By executing 
threads loaded in multiple hardware contexts, an otherwise idle processor can keep busy, 
thus increasing its utilization. However, the larger size of a multi-thread working set can 
have a negative effect on cache conflict misses. In this paper we evaluate the two 
phenomena together, examining their combined effect on execution time.The usefulness 
of multiple hardware contexts depends on: program dat ... 

13 Performance prediction of distributed load balancing on multicomputer systems 
Ishfaq Ahmad, Arif Ghafoor, Kishan Mehrotra 

August 1991 Proceedings of the 1991 ACM/IEEE conference on Supercomputing 
Supercomputing '91 

Publisher: ACM Press 

Full text available: Qpdf( 1.08 MB) Additional Information: full citation, references, citings, index terms 



14 Dataflow machine architecture 
rfsty Arthur H. Veen 

December 1986 ACM Computing Surveys (CSUR), Volume 18 issue 4 
Publisher: ACM Press 

Full text available* f 5 ^ pdf(3 19 MB) Additional Information: full citation , abstract , references, citings, index 
* — ' terms 

Dataflow machines are programmable computers of which the hardware is optimized for 
fine-grain data-driven parallel computation. The principles and complications of data- 
driven execution are explained, as well as the advantages and costs of fine-grain 
parallelism. A general model for a dataflow machine is presented and the major design 
options are discussed. Most dataflow machines described in the literature are surveyed on 
the basis of this model and its associated technology. F ... 

15 Linux on Carrier Grade Web Servers 
Ibrahim Haddad, Makan Pourzandi 
April 2001 Linux Journal 
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Publisher: Specialized Systems Consultants, Inc. 

Full text available: \§t\ html(2Q.63 KB) Additional Information: ful]_ citation, abstract, references, index terms 
A great software solution for web traffic problems. 

16 Enabling dynamic content caching for database-driven web sites ' 
K. Selguk Candan, Wen-Syan Li, Qiong Luo, Wang-Pin Hsiung, Divyakant Agrawal 
May 2001 ACM SIGMOD Record , Proceedings of the 2001 ACM SIGMOD international 

conference on Management of data SIGMOD '01, volume 30 issue 2 
Publisher: ACM Press 

Full text available- I P] pdf(31 9 67 KB) Additional Information: full ci tation , abstract, references, citings, index 
[Aj terms 

Web performance is a key differentiation among content providers. Snafus and slowdowns 
at major web sites demonstrate the difficulty that companies face trying to scale to a 
large amount of web traffic. One solution to this problem is to store web content at 
server-side and edge-caches for fast delivery to the end users. However, for many e- 
commerce sites, web pages are created dynamically based on the current state of 
business processes, represented in application servers and databases 
Keywords: JDBC, application server, database driven web site, dynamic content caching, 
invalidation, web acceleration 



17 Scalable scheduling on a network of workstations 
Sanglu Lu, Li Xie 

>^ April 2000 ACM SIGOPS Operating Systems Review, Volume 34 issue 2 
Publisher: ACM Press 

Full text available:^ pdf(675.97 KB) Additional Information: fuJL.citation, abstract, in_dex.ie_rrns 

This paper presents an adaptive scalable scheduling model ASCS based on NOWs, which 
provides a dynamic load sharing facility by allowing tasks to scale up to utilize desired 
excess computing capacity depending upon available workstations on a NOW, and also 
scale down to maintain workstation autonomy. In this paper, a hierarchical scheduling 
policy is described: the inter-cluster scheduling provides a simple, fast and less-overhead 
load sharing among clusters in the system; and the intra-cluster ... 

Keywords: coscheduling, load balancing, migration, scalable design, scheduling 
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18 Scalable molecular.dynamics for large biomolecular systems j 
Robert K. Brunner, James C. Phillips, Laxmikant V. Kale 

November 2000 Proceedings of the 2000 ACM/IEEE conference on Supercomputing 
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Publisher: IEEE Computer Society 

Full text available: , gj pdf(21„1 .89 KB) Additional Information: full citation, abstract, references, citings, index 
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We present an optimized parallelization scheme for molecular dynamics simulations of 
large biomolecular systems, implemented in the production-quality molecular dynamics 
program NAMD. With an object-based hybrid force and spatial decomposition scheme, and 
an aggressive measurement-based predictive load-balancing framework, we have 
attained speeds and speedups that are much higher than any reported in literature so far. 
The paper first summarizes the broad methodology we are pu ... 
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Bruce S. Siegell, Peter A. Steenkiste 

December 1995 Proceedings of the 1995 ACM/IEEE conference on Supercomputing 
(CDROM) - Volume 00 Supercomputing '95 

Publisher: ACM Press 

Full text available:^ pdf(6.26 MB).j«] Additional information: full citation, abstract, references, citings, index 
html(2,56 KB) terms 

An important challenge in the area of distributed computing is to automate the selection 
of the parameters that control the distributed computation. A performance-critical 
parameter is the grain size of the computation, i.e., the interval between successive 
synchronization points in the application. This parameter is hard to select since it depends 
both on compile time (loop structure and data dependences, computational complexity) 
and run time components (speed of compute nodes and network). On ... 

Keywords: Automatic parallelization, grain size, network of workstations, dynamic load 
balancing 
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